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ABSTRACT 

Recent  work  by  the  authors  and  others  has  demonstrated  the  connections 

between  the  dynamic  programming  approach  to  optimal  control  theory  and  to  two¬ 
s'" 

person,  zero-sum  differential  games  problems  and  the  new  notion  of  "viscosity1* 
solutions  of  Hamilton- Jacobi  PDE's  introduced  by  M.  G.  Crandall  and  P.  L. 
Lions.  In  particular,  it  has  been  proved  that  the  dynamic  programming 
principle  implies  that  the  value  function  is  the  viscosity  solution  of  the 
associated  Hamilton- Jacobi-Bellman  and  Isaacs  equations.  In  the  present  work, 
it  is  shown  that  viscosity  super-  and  subsolutions  of  these  equations  must 
satisfy  some  inequalities  called  super-  and  subdynamic  programming  principle 
respectively.  This  is  then  used  to  prove  the  equivalence  between  the  notion 
of  viscosity  solutions  and  the  conditions,  introduced  by  A.  Subbotin, 
concerning  the  sign  of  certain  generalized  directional  derivatives. 
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DIFFERENTIAL  GAMES,  OPTIMAL  CONTROL  AM)  DIRECTIONAL  DERIVATIVES 
OF  VISCOSITY  SOLUTIONS  OF  BELLMAN'S  AM)  ISAACS'  EQUATIONS 

1  2 
P.  L.  Lions  and  P.  E.  Souganidis 

INTRODUCTION 

Recent  work  by  the  authors  and  others  has  demonstrated  the  connections 
between  the  dynamic  programming  approach  to  optimal  control  theory  problems 
and  to  two-person,  zero-sum  differential  games  and  the  new  notion  of  "vis¬ 
cosity"  solutions  of  Hamiltcn-Jacobi  partial  differential  equations  intro¬ 
duced  by  M.  G.  Crandall  and  P.  L.  Lions  [6] . 

11)6  formal  relationships  here  are  (cf  *  W.  H.  Fleming  and  R.  Rishel  [15] , 
R.  Isaacs  [18] ) :  if  the  values  of  various  optimal  control  problems  and  dif¬ 
ferential  games  are  regular,  then  they  solve  certain  first  order  partial  dif¬ 
ferential  equations  with  "min",  "max",  "max-min"  or  "min-max"  type  nonline¬ 
arity.  Hie  problem  is  that  usually  the  value  functions  are  not  smooth  encugh 
to  make  sense  of  the  above  in  any  obvious  way.  Many  papers  in  the  subject 
have  worked  around  this  difficulty:  see  Fleming  [12] ,  [13] ,  [14] ,  Friedman 
[15] ,  [16] ,  Elliott-Kalton  [8] ,  [9] ,  Krassovski-Subbotin  [20] ,  Subbotin  [28] , 
etc. 

Recently,  however,  the  new  notion  of  "viscosity"  solution  for  first 
order  partial  differential  equations  was  introduced  by  M.  G.  Crandall  and 
P.  L.  Lions  [6].  (Also  see  M.  G.  Crandall,  L.  C.  Evans  and  P.  L.  Lions  [5]) . 
This  solution  was  proved  to  be  unique  under  same  very  general  assumptions. 
Moreover,  it  was  observed  by  P.  L.  Lions  [21]  that  the  dynamic  programming 
condition  for  the  value  in  control  theory  problems  inplies  that  this  value 
is  the  viscosity  solution  of  the  associated  Hamiltcn-Jacobi-Be liman  partial 
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di f ferential  equation.  These  considerations  extend  to  the  theory  of  differ¬ 
ential  games.  It  follows,  in  particular,  that  the  dynamic  programing  condi¬ 
tions  imply  that  the  values  are  viscosity  solutions  of  the  associated  Hamilton- 
Jaoobi- Isaacs  partial  differential  equations.  See  P.  Souganidis  [26] , [27] 
for  a  proof  of  this  based  on  both  the  Fleming  and  the  Friedman  definitions 
of  upper  and  lower  values  for  a  differential  game,  N.  Barren,  L.  C.  Evans 
and  R.  Jensen  [1]  for  a  different  proof  for  the  Friedman  definition,  L.  C. 
Evans  and  P.  Souganidis  [11]  for  the  Ell iott-Kalton  values  in  ,  L.  C. 

Evans  and  H.  Ishii  [10]  for  the  Elliott-Ka I  ton  values  in  bounded  domains. 

Sane  related  papers  are:  P.  L.  Lions  [23] ,  P.  L.  Liens  and  M.  Nisio  [25] , 

I.  Capuzzo  Doleetta  and  L.  C.  Evans  [3],  I.  Capuzzo  Doleetta  [2],  I.  Ca- 
puzzo  Doleetta  and  H.  Ishii  [4] ,  H.  Ishii  [19] ,  etc. 

The  present  paper  is  concerned  with  the  relation  between  the  notion  of 
viscosity  sub-  and  supersolutions  of  the  Hamilton-Jacobi -Bellman  and  Isaacs 
equations  and  the  sign  which  must  be  assumed  at  every  point  by  certain  gene¬ 
ralized  directional  derivatives.  In  particular,  we  shew  that  super-  and  sub- 
solutions  of  Hamilton-Jaoobi-Bellman  and  Isaacs  equations  satisfy  certain 
inequalities  which  are  related  to  the  optimality  principle  of  dynamic  pro¬ 
graming.  under  same  assumptions  this  implies  a  particular  sign  for  cer¬ 
tain  generalized  directional  derivatives.  Finally,  this  sign  suffices  to 
characterize  functions  as  viscosity  super-  and  subsolutions  of  the  appro¬ 
priate  equations.  This  is  motivated  by  a  work  of  A.  Subbotin  [28] .  In 
particular,  Subbotin  gives  a  necessary  and  sufficient  condition  for  a  func¬ 
tion  to  be  the  value  of  a  differential  game.  This  condition,  which  is  not 
within  the  context  of  the  viscosity  solution,  roughly  says  that  at  every 
point  certain  generalized  derivatives  must  have  a  particular  sign.  L.  C. 

Evans  and  H.  Ishii  [10],  using  a  "blow-up"  argument,  showed  that  the  value 
of  an  infinite  horizon  control  problem  satisfies  Subbotin' s  condition,  as 
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it  applies  to  control  problems.  Hie  techniques  used  here  are  different 
than  the  ones  in  110] .  One  direction  of  the  equivalence  claimed  above  is 

straightforward .  Hie  other  is  closely  related  to  the  principle  of  dynamic 
programming  and  requires  some  arguments  of  P.  L.  Lions  (22] ,  [24] ,  which 
treat  optimal  control  problems  of  diffusion  processes. 

Hie  paper  is  organized  as  follows:  Hie  rest  of  the  introduction  re¬ 
calls  the  definition  of  the  viscosity  solution.  Section  1  is  devoted  to 
optimal  control  problems.  Section  2  deals  with  differential  games.  In  the 
Appendix  we  make  some  observations  concerning  the  existence  of  directional 
derivatives  of  the  value  function.  All  the  definitions  and  results  from 
other  papers  are  recalled  when  necessary. 

We  conclude  the  introduction  with  the  definition  of  viscosity  solutions. 
Definition  0.1  [6].  Let  H  :  0  *  -*■  K  and  z  :  30  -*■  R  be  continu¬ 
ous  functions,  where  0  is  an  open  subset  of  A  continuous  function 

u  :  0 K  is  a  viscosity  subsoluticn  of 


(0.1) 


H(x,u,Du)  =  0  in  !) 
u(x)  =  z(x)  on  30 


if  u(x)  <_  z(x)  on  30  and,  moreover,  for 
is  a  local  max  of  u  -  tp,  then 


«  (*) 

every  $  €  C  (fl)  ,  if  Xq  €  0 


(0.2)  H(Xq,u(Xq)  ,D«(x0) )  <0 

A  continuous  function  u  :  0  -*■  R  is  a  viscosity  supersolution  of  (1.1) , 
if  u(x)  ^z(x)  on  30  and,  moreover,  for  every  <t>  €  c“(ft),  if  Xg  €  0 
is  a  local  min  of  u  -  <p,  then 


ion  For 

RAAI 

B 

need 

catlon_ 


(*)c“0j  0)  denotes  the  set  of  real  valued  infinitely  many  times  continuously _ _ 

differentiable  functions  (of  compact  support)  defined  on  &.  ,_J^j.riDution/ 


Availability  Codes 
jAvaii  and/or 
Dist  Special 


*  «<|***Vj 


(0.3)  HtXg^Xg)  ^'.Xq))  >.  0 


A  continuous  function  u  :  n  JR  is  a  viscosity  solution  of  (1.1) ,  if  it 
is  both  sub-  and  supersolution  of  (1.1) . 

Definition  0.2  (16)).  Let  H  :  ft  x  (0,T)  x  *  x  ir^  p  ,  z  :  313  «  [0,T)  -*•  * 
and  Uq  :  fi-  +  P  be  continuous  functions,  where  0  is  an  open  subset  of 
A  viscosity  subeoluticn  (respectively,  supersolution,  solution)  of 


~  +  H(t,x,u,Du) 


(0.4)  J 


u(x,t)  «  z(x,t) 
u(x,0)  »  Uq  (x) 


0  in  0  *(0,T] 
on  an  x  (o,t! 
on  0 


is  a  function  u  £C(Qp/*^**^  such  that: 

(0.5)  u  <_  z  on  3fl  x  [0,T] ,  u(x,0)  <_  Uq(x)  in  n 


(respectively. 


(0.6)  u  ^  z  on  3(2  x  I0,*f] ,  u(x,0)  >.  Uq(x)  in  fi 

respectively  (0.5)  land  (0.6)). 
and;  far  every  4  €  C*  (Qp) , 


(0.7) 


if  (x0,tQ)  €  Qp  is  a  local  max  of  u  -  <p,  then 
|£  <Vty  +H(t0,x0,u(x0,t0),D4(x0,t0))  <0 


(respectively. 


if 


(0.8)  ^ 


(xQ,tg)  g  (^,  is  a  local  min  of  u  -  <p,  then 

f<VV  +  H(t0,x0fu(3CQ,t0VD4(Xg,t0))  >0 


respectively  (0.7)  and  (0.8)). 

For  a  detailed  account  of  the  recent  developments  in  the  theory  of  vis¬ 
cosity  solutions  as  well  as  references,  we  refer  to  the  book  by  P.  L.  Lions 
[21]  and  the  article  by  M.  G.  Crandall  and  P.  Souganidis  [7] . 

SECTION  1 

In  this  section  we  consider  Hamilton-vTaoobi-Bellman  equations  associa¬ 
ted  with  optimal  control  problems.  In  particular,  we  look  at  problems  of 
the  form 

[  u  +  sup  t-f(x,y)*Du  -  l(x,y)}  ■*  0  in  ft 

(1.1)  J 

I  u  =  g  on  3ft 

where  ft  is  an  open  subset  of  if* ,  g  €  C(3ft) ,  Y  is  sane  separable  metric 
—  N  _ 

space  and  f  :  ft  x  y->  b  ,  Mx,y) :  ft  *  Y-*7R  are  continuous  functions  such 
that 


(1.2) 


r  There  exists  a  constant  C  >  0  such  that 

|f(x,y)  |,U(x,y)  j  <  C  for  every  (x,y)  €  ft  x  Y 
<  and 


|f(x,y)-f(x,y)  | ,  |  t(x,y) -t(x,y)  |  £C|x-x| 
for  every  (x,x,y) 


(1.1)  corresponds  to  an  infinite  horizon  control  problem  (for  the  details 


we  refer  to  [21]  and  W.  Flaming  and  R.  Rishel  [15])  with  dynamics  given  by 


6- 


(1.3) 


=  f'x(r) ,y(-r))  for  0  <  t 
I  x(0)  =  x  €  n 


where  y  :  [0 ,«)-*■  Y  is  measurable.  For  notaticnal  simplicity  in  vhat  fol¬ 
lows  let 

(l*4)  M  =  {y  :  [0,<»)  -*■  Y,  y(*)  measurable) . 


Let  u  be  the  unique  viscosity  solution  of  (1.1)  if  it  exists.  It  is 
known  (P.  I-..  Lions  [21] ,  I.  Capuzzo  Dolcetta  and  L.  C.  Evans  [  3  ] ,  L.  C. 
Evans  and  H.  Ishii  [10])  that  u  satisfies  the  optimality  principle  of  dy¬ 
namic  programming,  that  is 


(1.5) 


fu(x)=inf{e  ^^ufxftAt^))  +  f^^e  s«.(x(s)  ,y(s))ds)  for 
M  •  J  0 


every  t  >  0  and  x  €  ff 


,(*) 


where,  for  x  €  n  and  y  €  M,  t„  =  t..(y)  is  the  exit  time  from  n  of 
the  solution  of  (1.3)  for  the  particular  x,y,  i.e.. 


(1.6)  =  >  0  :  x(fc)  €  -  0) 

Hie  first  result  of  this  section  concerns  viscosity  supersolutions  of 
(1.1) .  In  particular,  we  show  that  every  viscosity  supersoluticn  of  (1.1) 
satisfies  some  inequality,  which,  in  view  of  (1.5) ,  may  be  called  superop¬ 
timality  principle  of  dynamic  prograrmving.  This  was  first  proved  by  P.L.  Lions 
in  [22],  [24],  in  the  general  context  of  optimal  stochastic  control.  Here  we  give 
two  proofs  related  to  those  given  in  [22] ,  [24] ,  but  slightly  more  adapted 

(*)  r  a  s  =  min{r,s) 
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to  the  special  situation  at  hand.  The  first  proof  uses  the  fact  that  a 
viscosity  supersolution  of  (1.1)  is  a  viscosity  supersolution  of  an  ap¬ 
propriately  defined  time  dependent  problem.  The  second  proof  is  based  on 
the  fact  that  a  viscosity  supersolution  of  (1.1)  is  a  viscosity  solution 
of  an  obstacle  problem,  which  can  be  solved  easily  using  differential  games. 
The  first  step  in  both  proofs  is  a  localization  argunent  introduced  in  [24] . 
It  consists  of  multiplying  by  suitable  cut-off  function.  This  allows  us  to 
reduce  to  the  case  fi  =  3^  . 

We  have 

Proposition  1.1.  Let  v  €  C(ft)  be  a  viscosity  supersolution  of  (1.1) . 

Then,  for  every  t  >  0  and  x  €  n,  we  have 

(1  6)  v(x)  >  inf{e_(tAt>c^v(x(tAt  <))  +  [  e“S£(x(x)  ,y(s)  )ds} 

v  '  ”  M  x  Jo 

Proof  1.  The  first  step  in  the  proof  is  to  modify  the  problem  so  that  it 

is  defined  in  it*.  To  this  end,  for  6  >  0  let  n  be  defined  by 

0 

fij  =  {x  £  ft  :  |x|  <  ^  and  dist(x,3ft)  >  6} 

Moreover,  choose  £,<P  €  C°°  [iF)  such  that:  0  £  £  1  1  on  ft.,  0  <  5  <  1, 

6  —  — 

5  =  0  on  if*  "*0 &/2 ,  <P  =  1  on  a  neighborhood  of  suppS ,  0  ±  4>  <_  1  and  <ps  0 
on  I ^^5/4.  Then  the  function  y  :  -*•  R  which  is  defired  by 


y(x) 


(<Pv)  (x)  in  ft 

0  in  T^ft 


is  a  viscosity  super solution  of  the  problem 


(1.7) 


|(x)vi  +  sup{-^(x)  f  (x,y)  *Du-5(x)  i.(x,y) )  =  0  in  K 
y€Y 


N 


tM 
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Next  for  t  >  0  fixed  consider  the  initial  value  problem 


(1.8) 


dw 


r-  +  sup  (-£(x)f(x,y)  *Dw-£(x)  i(x,y)  >  +  C(x)w  =  0  in  Q. 
38  y€y  ^ 

w(x,0)  =  v(x)  in  I? 


In  view  of  the  results  of  [6]  and  [21] ,  (1.8)  has  a  unique  viscosity  so¬ 
lution  w  €  C(lF  x  [0,t])  given  by 

-f  -  ,s  r  . 

(1.9)  w(x,s)  »  inf{v(x(s))e  Jo5(x(T,)dT  +  e  ioc(x(A)  )dX  *(x(t)  ,y(x)  Jdt} 

M  j0 


where  x(  •)  is  the  solution  of 

J  =  -«x(T))f(x(T)  ,y(x))  for  0  <  T  <  t 

1  x(0)  =  x 

V,  however,  is  a  visoosity  supersolution  of  (1.8) .  The  uniqueness  es¬ 
timates  of  [6]  iitply 

v(x)  ^w(x,s)  for  every  (x,s)  €  ll**  [0,t] 

Next  observe  that  for  x  €  fi  and  y  €  M,  if  t  <  tx,  then  x(s)  =  x(s) 
for  0  ±  8  £  t,  where  x(  •)  is  the  solution  of  (1.3),  provided  that  6  is 
sufficiently  small.  Moreover,  x(  •)£  (x  £  fl  :  ((x)  a  1).  These  observations 
together  with  (1.9)  ijnply  (1.6)  for  t  <  tx.  If  t  >_  tx,  choose  tR+tx. 

Then 

v(x)  >_  inf(v(x(t  ))e_tn  +  [  e”s  i(x(s)  ,y(s)  )ds) 
y€M  J0 


As  n  +  «  we  obtain  (1.6) ,  since  v  €  C(Q) . 


Proof  2.  (Obstacle  problem  method)  .  Here,  in  order  to  exhibit  the  rain 
ideas,  for  simplicity,  we  cure  going  to  assume  fl  =  .  The  general  case 

follows  by  appropriate  use  of  the  localization  technique  explained  in 
Proof  1. 

It  is  easy  to  see  that  v  is  the  unique  viscosity  solution  of  the 
problem 


v  +  min{sup{-f(x,y)  *Dv-£(x,y) },  -v)  =  0  in  1^ 
which  can  be  rewritten  as 

(1.10)  v  +  m|n  suj3  {-f  (x,y,2)  *Dv-h(x,y,z)  }  «  0  in 

with  Z  =»  {1,2}  and 


|  f(x,y,z) 
h(x,y,z) 


0,  if  z  =  1 
f  (x,y) ,  if  z  =  2 

v(x) ,  if  z  =  1 
-fc(x,y) ,  if  z  =  2 


(1.10)  (corresponds  to  an  infinite  horizon  differential  game,  thus  v  nust 
satisfy  the  dynamic  programming  principle,  as  it  is  shown  in  the  first  part 
of  L.  C.  Evans  and  H.  Ishii  [10] . 

We  need  seme  more  notation.  In  particular,  let 


N  *  {z  :  [0,«)  -*•  Z,  z(')  measurable) 


Moreover,  denote  by  r  the  set  of  mappings  o  :  n  -*■  M,  which,  far 


every  t  >  0,  satisfy  the  following  condition: 
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If  z(x)  =  £  [s)  for  a.e.  0  ±  s  <_  t,  then 


a[z](s)  =  a  [z]  (s)  for  a.e.  O^s^t 
In  view  of  Theorem  3.1  of  [10] ,  for  every  t  >  0,  we  obtain 

ft 


(1.11)  v(x)  =  inf  sup  { 

aer  zeN 


e  ^(xts)  ,a[z]  (s)  ,z(s))ds  +  e-tv(x(t))} 


where  for  x  €  iP  ,  z  £  N  and  a  €  r,  x(*)  is  the  unique  solution  of 


=  -f  (x(s)  ,a[z]  (s)  ,z(s))  for  0  <  s 
x(0)  =  x 


Choose  z  £  N  such  that  z  =  2.  Then  (1.11)  implies 

Vt2(x(t)  ,a[¥]  (t)  ) dt } . 
) 

since,  in  this  case,  x(»)  is  the  solution  of  (1.3) .  But 


v(x)  >  inf  {v(x(t))e 
“  a£r  . 


j  0 


[a[z]  :  a  €  D  c  M 


thus  the  result. 

The  next  proposition  deals  with  viscosity  subsolutions  of  (1.1)  .  In 
particular,  we  shew  that  a  viscosity  subsolution  of  (1.1)  satisfies  an  in¬ 
equality,  which  we  call  the  suboptimality  principle  of  dynamic  programming. 
The  proof  relies  on  the  fact  that  viscosity  subsolutions  of  (1.1)  are  vis¬ 
cosity  subsolutions  of  an  appropriately  define.’  time  dependent  problem. 

We  have 

Proposition  1.2.  Let  w  £  C(2)  be  a  viscosity  subsolution  of  (1.1)  . 
Then,  far  every  x  £  and  t  >  0,  we  have 


(1.12)  w(x)  <  inf  ie  ^tAtx^w(x(t At  ))  +  (  x  e  s*(x(s)  .y(s))ds) 

M  x  Jo 

Proof.  Here  we  give  the  proof  in  the  case  n  =  .  For  the  general  case, 

one  has  to  use  first  a  localization  argument  as  in  Proof  1  of  Proposition 

1.1. 

For  t  >  0  consider  the  problem 

32 

—  +  max  {-f  (x,y)*Dz-£(x,y)  }  +  z  =  0  in  Q> 

1  3S  y€y  ~ 

z(x,0)  =  w(x)  in 

w  is  a  viscosity  subsolution  of  this  problem,  therefore,  for  every  x  € 

w(x)  <_  z  (x,t)  =  inf{w(x(t))e  +  (  e_s  jtfx(s)  ,y(s)  )ds} 

M  Jo 

The  above  are  justified  as  in  Proof  1  of  Proposition  1.1. 

Next  we  want  to  use  Propositions  1.1  and  1.2  to  obtain  a  kind  of  inf ini 
tesimal  version  of  the  super-  and  sub  optimality  principle  of  the  dynamic 
programing,  satisfied  by  viscosity  super-  and  subsoluticns  of  (1.1)  .  To 
do  this,  we  have  to  assume  that  we  work  with  sub-  and  super  solutions  which 
are  locally  Lipschitz.  Moreover,  we  need  to  introduce  seme  notation. 

(1*13)  (PL)  (x)  =  cxj{(f  (x,y) ,  fc(x,y))  :  y  €  Y} 

We  have: 

0  1  (*) 

theorem  1.3.  Let  v  €  Cj^(n)  be  a  viscosity  super  solution  of  (1.1) . 
then,  for  every  x  €  Si,  it  is: 

v(x)  +  lim  sup  fvOcHvUj-gf)  .  t  \  >  Q 

6  +  0  (f,*)€(FL)  (x)<  6  >  ~ 


(1.14) 
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and  the  inequality  is  achieved  as  5+0  uniformly  cn  compact  sets. 

Proof:  For  x  6  ft  fixed  let  K  be  the  Lipschitz  constant  of  v  in  a  ball 
of  radius  C  centered  at  x,  where  C  is  given  by  (1.2) .  Moreover,  as¬ 
sume  that  0  <  6  <  1  is  snail  enough  so  that  6  <  t^.  In  view  of  Proposi¬ 
tion  1.1,  we  have: 


sup 

M 


_6  r6 

v(x)  -e  v(x  +  f  (x(s)  ,y(s»ds) 

6  JO 


l(x(s)  ,y(s))3s 


>  0 


Therefore 


ip!Sv(x>+  -  |JS*(x,y<s»ds 

,  ‘  -a  . 

>  "  (K+1)C  6  -  C  (1+  6  ) 


But 


J^f(x,y(x))ds,  ~  |^t(x,y(s))dsj 


,y(s))ds  e  (FL)  (x) 


The  above  inequality  implies 


1-e 


-6 


,  .  -6 
v(x)  +  e  sup 

(f,a)€(FL)  (x) 


v(x)-v(x»6f) 


- 1 


■^-(K+l)  C2  6-C  (1+^ 

6 


Letting  6+0  we  obtain  the  result.  The  uniformity  claimed  in  the  state¬ 
ment  is  an  immediate  consequence  of  the  fact  that  the  above  also  holds 
for  every  y  €  in  a  neighborhood  of  x  of  radius  C/2. 

As  a  consequence  of  Theorem  1.3  we  have 
Corollary  1.4.  Let  v  €  C^^(n)  be  a  viscosity  supersolution  of  (1.1) . 
Then,  for  every  x  6  n,  it  is: 


(1.15)  v(x)  +  sup 

(f,U€(FL)  (x) 


is  y(x).--ywf)  ,t 
6+0  « 


>  0 
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and  the  inequality  is  achieved  as  6+0  uniformly  on  ocnpact  sets. 

Remark  1.5.  In  the  second  part  of  (Ld  L.  C.  Evans  and  H.  Ishii  proved  that 
if  (f(x,y)  :  y  €  Y}  is  convex  and  i(x,y)  =  0,  then  a  locally  Lipechitz 
viscosity  supersolution  of  (1.1)  satisfies 

inf  LUn  e'Wif>-vW  <  „ 

y  &  m  6 

which,  under  their  assumptions,  is  equivalent  to  (1.15) .  As  mentioned  in  the 
Introduction,  they  used  a  "blow-up"  argument.  Hie  proof  we  give  here  is  based 
completely  on  Proposition  1.1  and  Theorem  1.3. 

Proof  of  Corollary  1.4:  (1.14)  implies  that  there  is  a  subsequence  6^+0 

as  k  ->-  «  such  that 


v(x)  +  lim  sup 

k-x»  (f ,  £)  €(FL) 


1 

(x) 


v(x)  -v(x+6yf)  _( 


>  0 


Then  for  e  >  0  fixed  but  arbitrary  there  is  a  kg  =  kg(E)  >0  such  that 


v(x)  +  sup 

(f,  S)e(FL)  (x) 


v(x)-v(x+6yf)  _  t 


>  "E 


for 


k  >  JCq. 

Next  for  each  k  ^  kg  choose  (f^,  £^) 


Xij^Stg^kL  _£  =  sup 

*  k  (f ,  i)  C(PTj)  (x) 


.€  (FL)(x)  such  that 

v(x)  -*v(x+-  Vf)  , 

*k 


The  compactness  of  (FL)  (x)  implies  that  along  some  subsequence  of  6^+0 
(which  again  for  simplicity  is  denoted  by  6^)  we  have 


(fk'*k)  "  {f,l)  €  {FL)  (x) 


This,  together  with  the  Lipechitz  property  of  v,  implies 


v(x)  >  o 

k~  |  5k  |  “ 

and,  therefore,  the  result. 

Remark  1,6.  It  is  of  sane  interest  to  know  whether,  in  the  case  at  hand, 

(1.15)  holds  with  Tun  replaced  by  lim. 

Far  the  case  of  a  viscosity  subsoluticn  of  (1.1)  we  have: 

Theorem  1.7.  Let  w  6  C?'*(n)  be  a  viscosity  subsolution  of  (1.1) .  Then, 
__________  loc 

for  every  x  e  n/  we  have 


(1.16) 


and 


(1.17) 


w(x)  +  lim  sup 

6+0  (f,*)€(FL)  (x) 


w(x)  +  sup  Tim 

(f ,!)€ (FL)  (x)  6+0 


w(x)-w(x»6f)  _  t 


<  0 


w(x)-w(x+6f) 
- 1 - l 


<  0 


and  the  inequality  is  achieved  as  6+0  uniform] y  on  carfaot  sets. 

Proof:  (1.17)  follows  inmediately  from  (1.16).  To  prove  (1.16)  observe 
that,  in  view  of  Proposition  1.2,  we  have: 

f6 


w(x)  ■ 


a~6w(x+f  f  (x(s)  ,y(s)  )ds  f6 
6*0 


-I 

J0 


-s 


e  t(x(s)  ,y(s))ds  10 


and,  therefore 

(1.18)  .  e'8  1  f  «*,y(s))ds 

<  (K+1)C26  +  C  (l+e  ■  ^) 

6 


for  every  y  €  M,  where  K  is  the  Lipschitz  constant  of  w  in  the  ball  of 
radius  C  centered  at  x+ 


In  view  of  the  general  geometrical  fact 
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{ (||  f(x,y(s))ds,|j^t,(x,y(s))ds)  :  y  €  M}  =  co  { tf  (x,y)  ,  d(x,y) )  :  y  €  Y} 


(1.18)  implies 


w(x)  +  e  ^ 


sup 

(f,i)£(FL)  (X) 


w(x)  -w(x+6f) 


-  I 


<  0(1) 


where  0(1)  -►  0  as  6+0  and  thus  (1.16).  The  uniformity  follows  from  the 
fact  that  all  the  above  holds  with  the  same  constants  for  all  points  in  an 
appropriate  neighborhood  of  x. 


Combining  Corollary  1.4  and  Theorem  1.6  we  obtain 

.0,1, 


Corollary  1.8.  Let  u  €  C-j^(n)  be  a  viscosity  solution  of  (1.1) .  Then 


(1.19)  u(x)  +  sup 

(f,fc)£(FLXx) 


luu 

u(x)-u(x+6f) 

—  9 

6+0 

6 

X, 

=  o,  vx  e  n 


We  conclude  this  section  with  a  result  which  is  the  inverse  of  Corollary 

1.5  and  Theorem  1.7.  In  particular,  it  says  that  (1.15)  and  (1.17)  together 

with  appropriate  boundary  conditions  characterize  continuous  functions  as 

« 

viscosity  super -respectively  subsolution  of  (1.1) .  We  have 

Proposition  1.9.  (a)  Let  v  £  C(ft)  satisfy  (1.15)  for  every  x  €  ft.  Then 

v  satisfies  (0.3)  with  H  as  in  (1.1) . 

(b)  Let  w  £  C(n)  satisfy  (1.17)  for  every  x  £  ft.  Then  w  satisfies 
(0.2)  with  H  as  in  (1.1) . 

CO  ' 

Proof:  (a)  For  $  €  C  (ft)  let  Xg  €  ft  be  a  local  mininum  of  v-4>. 

We  want  to  shew  that 


v(Xq)  +  sup  {-ffx^y)  -DiMx^y)  +  fctx^y)}  >_  0 


But  for  6  sufficiently  small  we  have 
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4(Xq)-+(xq+6£)  v(Xq) -v(xQ+sf) 


l  far  all  (f ,  t)  €  (EL)  (Xq) 


This  inequality  and  (1.15)  inply 


v(x,0  +  sup  (-f^D^x*)  -  *}  >  0 

(f/t)  €  (BLMXq) 

Finally,  since 


supx  *  supx 
A€A  A€CoA 

we  have  the  result. 

(b)  The  proof  is.  similar  to  the  one  of  part  (a) ,  therefore  we  omit  it. 
Remark  1.10.  All  the  results  of  this  section  extend  to  several  other  cases 
including  time-dependent  problems.  The  type  of  statements  that  one  obtains 
are  similar  to  the  ones  of  Section  2. 

SBCTICN  2 

In  this  section  we  consider  Hamiltcn-Jaoabi  equations  which  are  rela¬ 
ted  to  theory  of  two -player r  zero-eun  differential  games.  Since  in  Section 
1  we  looked  at  stationary  problems,  here  to  show  the  generality  of  the  argu¬ 
ments  involved,  we  work  with  time  dependent  ones,  in  particular,  we  consider 
the  following  problems 


fjr  +  inf  sup{-f(t,x,y,z)  .DU  -  t(t,x,y,z)  }  =  0  in  nx(0,T] 

y€*  aez 


(2.1)  <U(x,t)  -  g(x,t)  on  3flx{0,T] 


[U(x,0)  =  Uq  (x)  in  n 


and 
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+  sup  inf{-f(t,x,y,z)  .DV  -  *(t,x,y,z)  }  *  0  in  n*(0,T] 

3  zez  y€Y 

(2.2)  <  V(x,t)  =  g(x,t)  on  30  x  [0,T] 

V(x,0)  ■  o0(x)  in  fl 


where  Y,Z  are  compact  sets  and  f  :  [0,T]  xfjxYxZ  ■*  iF  ,  i  :  [0,T]  x  a  x 
YxZ  +  K,  g  :  3 flx  [0,T]  -*■  F,  Uq  :  fl  B  are  bounded  continuous  functions. 
Moreover,  they  satisfy 


There  exists  a  constant  C  >  0  such  that 

|f(t,x,y,z)  |,  |l(t,x,y,z)  |  £C  for  every  (t,x,y,z)€[0,T]  x"n  Yxz 


(2.3)  J  and 


|f(t,x,y,z)-f(t,x,y,z)  |, |i(t,x,y',z)-t(t,x,y,z)  |  £C(|t-t|  +  |x-x|) 
for  every  (t,x,y,z) ,  (€,x,y,z)  6  [0,T]x  QxYxZ 


(2.1)  and  (2.2)  correspond  to  a  finite  horizon  two-player, zero-sum 
differential  game  (for  details  we  refer  to  W.  Fleming  [12] ,  [13] ,  [14] ,  Elliott 
and  Kaltcn  [8],  A.  Friedman  [16],  [17])  with  dynamics  given  by 


(2.4^ 


=  f(t,x(t)  ,y(x)  ,z(t)) 
x(T-t)  =  x  G  f! 


for  T  -  t  <  t  <  T. 


where  y  :  [t,T]  Y,  z  :  [t,T]  -*■  Z  are  measurable  functions.  Before  we 
continue  we  need  to  introduce  some  notation.  In  particular,  for  0  £  t  ^ T 
define 

M(t)  -  (y  :  [t,T]  Y  measurable} 

N(t)  =  (z  :  [t,T]  **■  Z  measurable) 


b 


* 


Moreover,  denote  by  r(t)  ,A  (t)  the  sets  of  mappings  a  :  N(t)  -*•  M(t) , 
B  :  M(t)  -*■  N(t)  respectively  with  the  following  property 


For  each  s  such  that  t  <  s  <  T 


and 


If 


z(t)  =  z(x)  for  a.e.  t  <_  x  s,  then 
a[z](x)  =  a[z](x)  far  a.e.  t  <  x  <  s 


If  y(x)  =  y(x)  for  a.e.  t  ^  t  <_  s,  then 
Bly]  (t)  =  S [y]  (x)  for  a.e.  t  <_  x  <_  s 


Let  U,V  be  the  unique  viscosity  solutions  of  (2.1),  (2. 2)  respective¬ 
ly  if  they  exist.  It  is  known  (L.  C.  Evans  and  P.  Souganidis  [11]  for  £i  =  , 

L.  C.  Evans  and  H.  Ishii  [10]  for  stationary  problems)  and  it  follows  from  the 

results  of  this  section  for  other  cases  that  U,V  satisfy  the  optimality  prin¬ 
ciple  of  dynamic  programming,  that  is 

Far  (x,t)  €  n  x  (0,T)  and  6  >  0  such  6  <_  t 

r  (T-t+6)  At* 

V(x,t)  =  inf  sup  {  &(s,x(s)  ,y(s) ,B[y] (s) )ds  + 

B€A  (T-t)  y€M(T-t)  JT-t 

+  0(x(  (T-t+6)  At^  ,  T-  ( (T-t+6)  At^  )  } 


(2.5)  J 


and 


V(x,t) 


t  (T-t+6)  At* 

sup  inf  {  «.(s,x(s)  ,o[z]  (s)  ,z(s))ds  + 

oer(T-t)  z€N (T-t)  'T-t 


+  V(x(  (T-t+6)  Ay  ,  T-(  (T-t+6)  Atx)  > 


where,  for  x  €  n,  x(*)  is  the  solution  of  (2.3)T_fc  with  the  appropriate 
y(.)  ,z(*)  funcitons  and  t  is  the  exit  time  from  Qx(0,T)  of  x(»). 

She  first  result  of  this  section  concerns  viscosity  supersolutions  and 


.9' 


subsolutions  of  (2.1)  and  (2.2) .  In  particular,  we  shew  that  they  satisfy 
sene  inequalities,  which,  in  view  of  (2.5) ,  may  be  called  super-  and  sub¬ 
optimality  principle  of  dynamic  programming.  All  the  results  are  going  to 
be  stated  as  they  apply  to  the  general  problems  (2.1)  and  (2.2) ,  the  proofs, 
however,  for  simplicity  are  going  to  be  given  only  for  the  special  case 
fl-lf*.  To  obtain  the  most  general  results  one  has  to  use  the  localization 
argvxnent,  which  was  described  in  the  course  of  the  proof  of  Preposition  1.1. 
We  have 

Proposition  2.1.  Let  v,w  €  C(Qp)  be  viscosity  super-respectively  subsolu¬ 
tion  of  (2.1)  respectively  (2.2).  For  every  (x,t)  E  fix  (0,T)  and  6  >  0 
such  that  6  _<  t,  we  have 

t (T-t+6) 

(2.6)  v (x , t)  >_  inf  sup  {  t  fc(s,x(s)  ,y(s)  ,0 [y]  (s) )ds  + 

S€A(T-t)  y€M(T-t)  'T-t 

+  v  (x  ( (T-t+6)  Atx)  ,  T-  (T-t+5)  At^ )  ) 
and 

t  (T-t+6)  Atx 

(2.7)  w(x,t)  _<  sup  inf  {  j,(s,x(s)  ,  a[z]  (s)  ,z(s)  )ds  + 

a€T (T-t)  z€N (T-t)  JT-t 

+  w(x (T-t+6)  At^  ,  T- ( (T-t+6)  Atx) )  } 

Proof:  Here  we  prove  only  (2.6) ,  since  (2.7)  is  proved  in  exactly  the  same 

way.  As  mentioned  above  we  are  going  to  assume  n  =  . 

For  %  >  0  choose  £,<)>€ C°°(B)  such  that  0  <  E  <  1,  0  <  <  1,  £  =  1 

on  [c,T-e],  E  ;0  on  (-»,  e/2]  «  (T-|  ,«)  ,  $  =  1  on  (|-,T-  j  ] ,  <f>  s  0  on 

(-«.,-]  u(T- 4  ,»)  •  Moreover,  let  v  :  x  B  ■+■  B  be  defined  by 

6  <5 

U(s)v(x,s)  if  T  >_  s  >_  0 
v(x,s)  =  J 


0 


if  s  <  0  or  s  >  T 
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It  is  easy  to  check  that  v  is  a  viscosity  super  solution  of  the  problem 


C(s)-^  +  inf  sup(-Us)f(s,x,y,z)*DU  -  ?{s)  i(s,x,y,z))  =  0  in  l^+1 
y€Y  z€Z 

Next  let  T  >  t  >  <S  >  0  be  fixed.  Thai  v  is  also  a  viscosity  super- 
solution  of 


f  |^  +  inf  sup{-C(x)  f(s,x,y,z)*EW  +  £(s)~  -  ?(s)  i(s,x,y,z))  =  0 


(2.8)  ^ 


in  H?*41  x(0,T-t+5) 


3t  y€Y  zCZ  38 

W(x,s,0)  =  v(x,s)  in  iP1 

If  W  €  [0,T-t+6])  is  the  unique  viscosity  solution  of  (2.8) , 

the  uniqueness  estimates  of  [6]  irrply 


v(x,t)  >_  W(x,t,6) 

Moreover,  the  results  of  L.  C.  Evans  and  P.  E.  Souganidis  [11]  give 

fT-t+S 

W(x,t,6)=inf  sup  {  C(T-t+6-t(p))  £(T-t+6-t(p),x{p)  ,y(P)  ,B[y]  (P>))dfx 

B€A(T-t)  y€M(T-t)  >  T-t 

+  v(x(T-t+<5)  ,  t(T-t+6))} 


where  far  y  €  M(T-t)  and  ft  €  A'T-t),  x(*) ,  t(* )  are  the  solution  of 

^  =  c(T-t+«-t(p))f  (T-t+5-t(p),  x(p)  ,y(p)  ,6[y]  (p))  for  T-t<P<T-t+6 

=  -  £(T-t+6-t(p) )  for  T-t<P  <  T-t+  6 

x(T-t)  =  x,  t(T-t)  =  t 


As  e+0  the  above  observations  imply  the  result,  since  as  e  +  0 


x(0)  ■*  x(0)  uniformly  on  [T-t,T-t+6] 
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vhere  x(.)  is  the  solution  of  (2.4)T_t 

The  next  proposition  considers  subsolutions  of  (2.1)  ana  supersolutions 
of  (2.2) .  Since  the  proof  of  the  results  is  exactly  the  same  as  the  proof 
of  Proposition  2.1,  we  emit  it. 

Proposition  2.2.  Let  v,w  e  C(qt)  be  viscosity  sub-respect ively  superso¬ 
lution  of  (2.1)  respectively  (2.2).  For  every  (x,t)€  0  *  (0,T)  and  6>Q 
such  that  6  <_  t,  we  have 

f  (T-t+6)  At* 

(2.9)  v(x,t)  <_  inf  sup  fc(s,x(s)  ,y(s)  ,B[yJ  (s))ds  + 

0GA(T-t)  yCM(T-t)  JT-t 

+  v(x(  (T-t+6)  At^  ,T- (T-t+6)  At^ ) )  } 

and 

t  (T— 1+4)  Atj{ 

(2.10)  v(x,t)  >_  sup  inf  (I  s.(s,x(s)  ,a[z]  (s)  ,z(s)  )ds  + 

a€r  (T-t)  z€N(T-t)  JT-t 

+  w(x(  (T-t+6)  Atx)  ,  T-(  (T-t+6)  Atx) ) )  } 

Next  we  want  to  use  Proposition  1.1  to  obtain  a  kind  of  infinitesimal 
version  of  the  super-  and  suboptimality  principle  of  the  dynamic  prograntning. 
To  do  this  we  have  to  assume,  as  in  Section  1,  that  we  deal  with  locally 
Lipechitz  viscosity  super-  and  subsolutions.  Before  we  state  the  results 
we  need  some  notation.  We  have: 

[For  (t,x,y)  €  (0,T)  *  n*Y 

(2.11)  J 

I  (FL)  (t,x,y)  =  ro((f(t,x,y,z) ,l(t,x,y,z) )  :  z  €  Z} 

and 
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(2.12) 


Fbr  (t,X,2)  €  (0/T)  x  Qx  Z 

< 

(FL)  (t,x,z)  =  co  {(f  (t,x,y,z)  £(t,x,y,z) )  :  y  £  Y} 


The  result  is 

Proposition  2.3.  Let  v,w  €  n  x  (0,T) )  n  CtQp)  be  super-respectively 

subsiolution  of  (2.1)- respectively  (2.2).  Then  for  every  (x,t)  €0x(0,T) 
we  have 

(2.13)  lim  sup  inf 

Tiff  y€Y  (ff  i)€(VL)  (T-t,x,2) 

and 

(2.14)  lim  sup  inf 

6+0  z€z  (f,t)£(FL)  (T-t,x,2) 

with  the  inequalities  being  achieved  as  ‘  6+0  uniformly  cn  compact  sets. 
Proof:  Here  we  show  only  (2.13) ,  since  (2.14)  follows  in  a  similar  way. 
Par  a  fixed  (x,t)  €  n  x  (0,T)  let  K  be  the  Lipschitz  constant  of  v 
in  a  neighborhood  of  (x,t) .  For  5  >  0  sufficiently  small  it  is 


w(x,t)-w(x+-&f,t-6) 

6 


<  0 


w(x,t)-w(x+6f,t-6) 


T  -  t  +  6  <  fe_ 
x 


far  every  y  €  M(T-t) ,  6  €  A(T-t) ,  and  this  uniformly  for  every  x  in  a 
neighborhood  of  x.  (2.6)  then  rimplies 


sup  inf  fv(x,t)  -v(x(T-t+6)  ,t-6) 
e€A(T-t)y€M(T-t)  5 


irT-t+6 

T  t(s,x(s) ,y(s) ,g[y] (s))ds) > 0 
°'T-t  ~ 


But 


sup  inf  <_  •  inf  sup  <_  inf  sup 
B€A(T-t)  y€M(T-t)  y€M(T-t)  B£A  (T-t)  y€Y  6€A(T-t) 
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Therefore,  in  view  of  (2.3) ,(2.4) ,  we  have 


inf  sup 

y€Y  (f,£)£(FL)  (T-t,x,y) 


v(x,t)  -v(x+6f ,t-6) 
6 


l 


>  0(1) 


where  0(1)  -*•  0  as  6+0  uniformly  for  (x,t)  ,in  a  compact  set.  Here  we 


used  the  fact  that  for  y  £  Y 

,  /T-t+6  ,  rT-t+6 

(=4  f(T-t,x,y,6[yl  (s))ds,J  fc(T-t,x,y,B [y]  (s))ds)£(FL)  (T-t,x,y) 
6JT-t  JT-t 

for  every  6  £  A (T-t) . 

Letting  5+0  we  obtain  the  result. 

As  a  consequence  of  Proposition  2.2  we  have 

Corollary  2,4.  Let  v,w  6  cjj|'*(£}  x  (0,T)}  n  C(Q^)  be  super -respectively 

subsolutions  of  (2.1)- respectively  (2.2).  Bor  every  (x,t)  £  Ox(0,T) 

we  have 

v(x,t)-v(x+6f ,t-6)  _  .  I  >  n 


and 

(2.16)  sup  inf  lim 

z€Z  (f,Jt)£(FL)  (T-t,x,z)  6+0 

with  the  inequalities  being  achieved  as  •  6+0  uniformly  on  ccmpact  sets. 

i 

Since  Corollary  2.3  follows  from  Proposition  2.2  in  the  same  way  that 
Corollary  1.4  follows  from  Theorem  1.3  we  emit  its  proof. 

We  continue  with  a  proposition  and  a  corollary  concerning  viscosity 
sub-  and  supersolutions  of  (2.1)  and  (2.2)  respectively.  Since  these  re¬ 
sults  follow  fran  Proposition  2.2  the  same  way  as  Proposition  2.3  and  Cor¬ 
ollary  2.4  follow  from  Proposition  2.1  we  emit  their  proof.  We  should  also 
remark,  however,  that  one  can  obtain  these  results  directly  from  Proposition 


w(x,t)  -w(x+5f ,t-6) 


-  £ 


(2.15)  inf  sup  lim 

y£Y  (f,J.)€(FL)  (T-t,x,y)  6+0 


vt-5Si. 


d 


-24- 


2.3  and  Corollary  2.4,  by  observing  that  a  viscosity  subsolution  (superso¬ 
lution)  of  (2.1) ((2.2))  is  a  viscosity  subsolution  (supersolution)  of  (2.2) 
((2.1)).  We  have: 

Proposition  2.5.  Let  v,w  £  C®^'(n  x(0,T) )  n  C(§p)  be  sub-  respectively 
supersolution  of  (2.1)  respectively  (2.2) .  Then  for  every  (x,t)  €  ft  x  (0,T) 
we  have 


(2.17) 


lun  sup 
<5+0  z£Z 


inf 

(f,a)£(EL)  (T-t,x,z) 


v(x,t)  -v(x+6f  ,t-6) 


-l 


<  0 


and 


(2.18)  lim  inf  sup 

6W  y€Y  (f,&)€(FL)  (T-t,x,y) 


w(x,t)-w(x+6f ,t-6)  _ 


>  0 


with  the  inequalities  being  achieved  as  6+0  uniformly  on  compact  sets 

.0,1 


Oorollary  2.6.  Let  v,w  .£  (ftx(0,T) )  n  C(Qr)  be  sub-respectively  super¬ 

solutions  of  (2.1)  respectively  (2.2).  Ftsr  every  (x,t)  €  ftx(0,T)  we  have 


(2.19)  sup  inf  lim 

zez  (f,ii)e(iL)  (T-t,x,z)  &TU 


v(x,t)-v(x+5f,t-6)  _  ^ 


<  0 


and 


(2.20)  inf  sup  lim 

y€Y  (f,£)£(FL)  (T-t,x,y)  6+0 


w(x,t)  -w(x+6f  ,t-6) 


- 1 


>  0 


with  the  inequalities  being  achieved  as  6+0  uniformly  on  compact  sets. 

The  next  result  is  the  inverse  of  Corollary  2.4  and  Oorollary  2.5.  In 
particular,  it  says  that  (2.15) , (2.16) , (2.19)  and  (2.20)  together  with  ap¬ 
propriate  boundary  conditions  characterize  continuous  functions  as  viscosity 
super-  and  subsoluticns  of  (2.1)  and  (2.2) . 


We  have: 
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Propositicn  2.7.  (a)  Let  v  €C(flx(0,T))  satisfy  (2.15).  Then  v  also 

satisfies  (0.9)  with  H  as  in  (2.1). 

(b)  Let  w  eC(ft*(0,T))  satisfy  (2.16).  Then  w  also  satisfies  (0.8) 

with  H  as  in  (2.2) . 

(c)  Let  v€  C(fl*{0,T))  satisfy  (2.19).  Then  v  also  satisfies  (0.8) 

with  H  as  in  (2.1) . 

(d)  Let  w€  C(fl*(0,T))  satisfy  (2.20).  Then  w  also  satisfies  (0.9) 

with  H  as  in  (2.2) . 

Since  the  proof  is  similar  to  the  proof  of  Proposition  1.9(a) ,  we  omit 
it. 

We  conclude  this  section  which  is  an  inmedia te  consequence  of  Corollary 
2.4  and  Proposition  2.7.  We  have 

Corollary  2.8.  Suppose  that  for  every  (t,X/p)  £  (0 ,T]  x  n it  is 

(2.21)  sup  inf (-f(t,x,y,z) *p  -  i(t,x,y,z)  }  = 

z£Z  y€Y 

=  inf  sup{-f(t,x,y,z).p  -  *(t,x,y,z)  ) 
yOT  z€Z 

Then  a  function  u  €  CtQp)  0  C^(ft  x  (0,T))  is  a  viscosity  solution  of 
3u 

-sj-  +  srp  inf  (-f(t,x,y,z) -IXi  -  fc(t,x,y,z)}  =0  in  flx(0,T) 

zez  yor 

u(x,t)  =  g(x,t)  on  3JI  x  (0,T) 
u(xf0)  =*  Uq(x)  in  A 

if  and  only  if  u  satisfies  (2.15)  ,(2.16)  and  the  correct  boundary  conditions. 

Remark  2.9.  a  result  analogous  to  Corollary  2.8  is  proved  by  Subbotin  (28)  but 
not  in  the  context  of  viscosity  solutions.  In  particular,  in  (28)  (2.15)  and 


(2.16)  are  necessary  and  sufficient  conditions  for  a  locally  Lipschitz  con¬ 
tinuous  function  to  be  the  value  of  a  positional  differential  game,  under 
the  assumption  that  i  =  0  and  0  =  1^.  Corollary  2.8  also  implies  in  view 
of  the  results  of  [26] , [27] ,  [10] , [11] , [1] ,  that  notion  of  the  value  of  a  po¬ 
sitional  differential  game  is  the  same  as  the  value  of  differential  game  in¬ 
troduced  by  W.  Fleming,  A.  Friedman  and  N.  Elliott  and  J.  Kalton. 

Remark  2.10.  A  remark  analogous  to  Remark  1.6  holds  here  too. 
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APFENDIX 

In  view  of  Remark  1.6  and  Remark  2.10,  we  want  to  make  sane  (classical) 
observations  concerning  the  existence  of  directional  derivatives  of  the  value 
function  of  optimal  cm  troland  differential  games  problems.  For  simplicity 
here  we  investigate  the  case  of  an  infinite  horizon  optimal  oontrol  problem 
in  In  particular,  we  deed  with  the  existence  of 

lixn 

h+0  h 

for  all  x,x  £  ,  where  v  is  the  value  function.  Using  the  notation  of 

Section  1  let  us  also  assume: 


(1) 


f  For  every  x  €  ye  y  and  h  €  R 

|  f  (x+h,y)  r-  f  (x,y)  -  D* (x,y)  .h|  |h|e(|h|) 

and 


j  £(x+h,y)  -  i(x,y)  -  Dx*(x,y)*h|  £  |h|e(|h|) 
where  e(|h|)  -*■  0  as  |h|  -►  0 
For  every  y(*)  e  M,  let 

(2)  J(x,y)  =  j  e  S£(x(s)  ,y(s)  )ds 

JO 

where  x(-)  is  the  solution  of  (1.3)  with  x(0)  =  x.  Moreover,  let 

(3)  v(x)  =  inf  J(x,y) 

y£M 

In  view  of  the  discussion  in  Section  1  and  the  references  given  there,  v 
is  the  value  function  of  the  associated  optimal  control  problem. 
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We  have 

Proposition  A.l.  Assume  that  (1.2)  and  (1)  hold  with 


(4) 


1  >  sup  |D  f(x,y) 
(x,y)€*PxY 


Let  v  be  given  by  (3) .  Then 


v(x+hx)  ~  v (x) 
h.O  K 


exists  for  crxery  x,  X  €  t-P  and 

lim  :yn£M-  J(Vn)..lv(x) 


(5)  lim  =  inf 

h+3  h 


jn-*®  u*® 

Proof:  The  proof  is  a  consequence  of  the  following  lemna. 

I ,  equioont inuous  and 


LeranaA.2  Let  w(x)  *  inf  wx(x)  with  w/dr* 

i  . 

satisfying: 


(6) 


Vx  € 


3w 

1  there  exist  ■— -(x)  such  that 

d  X 


-^(x)|<«h)  -  0 
h  3*  1  h40 


Then  lim  -  exists  for  all  x  and  is  equal  to 


h*0 


(7) 


lim  -  inf 


h+0+ 


aw^n  .  .  i 

lim  |=—  (x)  ‘  w1  (x) 
m®  x 


w(x) 


In  view  of  our  hypotheses,  v  and  J(*  ,y)  satisfy  the  assumptions  of 
Lenina  2.  Therefore  here  we  only  prove  the  lemma.  We  have: 

Proof  of  Lemna  2:  Let  i  be  a  sequence  such  that 

In 

w  (x)  -*■  w(x)  as  n  -*■  - 


Then 


In  view  of  Renark  1.6  and  Remark.  2.10,  we  want  to  make  sane  (classical) 
observations  concerning  the  existence  of  directional  derivatives  of  the  value 
function  of  optimal  aontroland  differential  games  problems.  Fbr  simplicity 
here  we  investigate  the  case  of  an  infinite  horizon  optimal  centred,  problem 
in  .  In  particular,  we  dead,  with  the  existence  of 

lin,  v(»+hx)  -  v(x) 
h+0  h 

for  all  x, X  €  ,  where  v  is  the  value  function.  Using  the  notation  of 

Section  1  let  us  also  assume: 


(1) 


For  every 
|f(x+h,y) 


x€l^  ,  y  €  y  and  hen 

* 

<-  f(x,y)  -  Dxf(x,y)»h|  <  |h|e(|h|) 


< 


and 


|  «,(x+h,y)  -  i(x,y)  -  Dx-i(x,y)  *h|  <_  |h|e(|h|) 
where  e ( j h | )  ->-0  as  |h|  0 

For  every  y(«)  €  M,  let 

(2)  J(x,y)  =  P° e~sji(x(s)  ,y(s)  )ds 

Jo 

where  x(.)  is  the  solution  of  (1.3)  with  x(0)  =  x.  Moreover,  let 

(3)  v(x)  =  inf  J(x,y) 

y£M 


In  view  of  the  discussion  in  Section  1  and  the  references  given  there,  v 
is  the  value  function  of  the  associated  optimal  control  problon. 


.1.  Assume  that  (1.2)  and  (1)  hold  with 


(4) 


1  >  sup  |D  f(x,y) 

(x,y)€»NxY  * 


Let  v  be  given  by  (3) .  Then 


lim  v(x^  ~-v<x). 
h+0 


exists  far  every  x,  x€  and 


(5)  XM  ywvo-yM.  =  iaf 


h+0 


lim  :  y„  €  M,  J(x^ J  -  v(x) 

—  ax  n 


Proof;  lhe  proof  is  a  consequence  of  the  following  lama. 

Lemma  A.  2  Let  w(x)  -  inf  w1(x)  with  w,wl  equibcxnded ,  equioontinuous  and 

i 

satisfying: 


(6) 


(vx  €1^  ,|  *|  =  1  there  exist  ~-(x)  such  that 

oX 

w1(x+hx)  w^00_  _  |^L(xj  I  <6(h)  ■+•  0 

3x  1  h^O 


h 


Then  lim  w^_  exists  for  all  x  and  is  equal  to 

h+3+  n 


(7) 


lim  ^y-y(x)  =  inf 

h+0+  h 


lim  (x)  :  w1  (x)  +  w(x) 

n+®  x 


In  view  of  our  hypotheses,  v  and  J ( •  ,y)  satisfy  the  assumptions  of 
Lama  2.  Therefore  here  we  only  prove  the  lerma.  We  have: 

Proof  of  Lemma  2:  Let  i  be  a  sequence  such  that 
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w(x+hx)-w(x)  <  w^(x+hx)  -w^tx)  w^Cx)  «w(x) 

h  _  R  h 

<  |H^5(h)  +  ly- i 

-  3x  h 

<  iHE  ^W-W(h) 

—  n-*«> 


Therefore 


m 

there  a  is  the  ric^it  hand  side  of  (7) .  For  the  other  direction,  let  h^O 
be  such  that  hnM)  as  n  -*•  ».  Choose  such  that 

i_ 

v(x*hx)  iv  (3crt\,x)  l  v(xthhx)+  3cl  as  n -*•  - 

Then,  in  view  of  the  assumptions, 

in 

v  (x)  v(x)  as  n 


w(x+hx)^-w(x)  ^  a 


We  have 


(x) 


)-y(x)  , 


1 

n 


which  implies 


a  <  lin  vi^X?-^(x) 

h+0  h 


and  thus  the  result. 


Remark  3.  Results  analogous  to  the  above  also  hold  for  finite  horizon  con¬ 
trol  problems  and  differential  games.  In  the  finite  horizon  case,  one  does 
not  have  to  assure  (4) . 
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